Learn how to use your programming skill to build modern data processing pipeline

This time we will have Sascha Dittmann with a talk about building a modern data processing pipeline.

Thanks to bluehands GmbH for hosting us

Agenda

6:30 PM: Doors open

6:45 PM: Orga Intro

7:00 PM: Learn how to use your programming skill to build modern data processing pipeline - By Sascha Dittmann

Data quality has become a much discussed topic in the fields of data engineering and data science. It’s become clear that data validation is crucial to ensuring the reliability of data products and insights produced by an organisation’s data pipelines.

But can you do it completely with open source software?

Apache Airflow and dbt (data build tool) are among the prominent open source tools in the data engineering ecosystem, and while dbt offers some data testing capabilities, another open source data tool, Great Expectations, enhances the pipeline with data validation and can add layers of robustness.

Join expert Sascha Dittmann to explore the "dAG stack" and learn how to combine the functions of these three open source tools to build, test, validate, document, and orchestrate an entire pipeline, end to end, from scratch.

7:45 PM: Networking

---

Hosted By

Martina Kraus, Organizer

Christian Liebel, Organizer

Tanja Ulianova, Organizer

Christian Janz, Organizer

Ayden Mohammadi, Organizer

Complete your event RSVP here: https://gdg.community.dev/events/details/google-gdg-karlsruhe-presents-learn-how-to-use-your-programming-skill-to-build-modern-data-processing-pipeline/.